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(54) Utte: AUTOMATIC ADJUSTMENT PROCESSING FOR SENSOR DEVICES 

i 

(57) Abstract 

A system and method for automatically 
detemiining a set of default settings (with re- 
spect to a blank image) so that a unifomi and 
high contrast image result when, for exam- 
ple, a finger is present on a sensor device 
(320). A background noise image and other 
diagnostic data, such as non-functional ar- 
eas, are also automatically detennined with 
respect to the blank image and stored for fu- 
ture reference (330). The above processing 
is performed each time the sensor device is 
initialized. Once the initialization process is 
complete, the individual places the required 
biometric feature, for example, a finger on 
the sensor device. The methodology adjusts 
the set of default settings (340) to account for 
the condition of the biometric feature being 
imaged by increasing or decreasing the sen- 
sitivity level (341) of the sensor device. The 
detennination of optimum sets is achieved by 
analyzing specific regions of the image data 
rather ttrni the entire image. The present in- 
vention then captures multiple images at dif- 
ferent sensitivity levels since a specific re- 
gion may be optimized with respect to one 
set of settings and another region may be 
optimized with respect to another set of set- 
tings. The diagnostic data is then used to 
correct (350) the captured images by . substi- 
tuting any non-functional areas in the sensor 
device with average intensity values from neighboring regions. The multiple images are th^ combined to form a resultant hnage (370) by 
using a weighted and intensity-transformed combination of regions from the different images. 
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AUTOMATIC ADJUSTMENT PROCESSING FOR SENSOR DEVICES 

RELATED APPLICATIONS 

The present patent application is related to U.S. Patent Application Serial 

5 No. , entitled "Capacitive Fingerprint Sensor device With Adjustable Gain," 

by inventors Alexander G. Dickinson, Ross McPherson, Sunetra Mendis and Paul 
C. Ross and having a filing date of May 13, 1997, and having common assignees. 
This patent ^plication hereby incorporates by reference the above-referenced 
patent application. 

10 

FIELD OF THE INVENTION 

The present invention relates to sensor devices, and more particularly to a 
method and apparatus that accounts for device variabiUties and adjusts for 
variable conditions that are present when imaging an individual's biometric 
15 feature and in particular, a fingerprint image. 

BACKGROUND OF THE INVENTION 

Biometric-oriented personal identification techniques are becoming 
increasingly important in protecting personal property, such as l^top computers 

20 and cellular phones, preventing credit card and calling card fraud, limiting access 
to security areas, computers and information, and ensuring security for electronic 
commerce. Biometric identification techniques employ physical traits, 
measurements and other characteristics specific to an individual. These 
characteristics include, but are not limited to, voice prints, hand prints, 

25 fingerprints, retina patterns, and signature analysis. Typically, biometric 
identification and verification techniques compare an individual's stored 

1 
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biometric data against newly obtained biometric data when the individual desires 
use of a protected item, or access to a protected area or information. Due to its 
inherent nature, biometric data has the advantage of always being available for 
user identification and verification. However, also by its inherent nature, due to 

5 the vagaries of the human body, biometric data is often difficult to acquire in a 
consistent manner to yield an unambiguous measure of identity. 

The fingerprint biometric is probably the most widely used and researched 
biometric identification technique. Existing technology allows the relevant 
features of a fingerprint to be represented in a few hundred bytes of data. 

10 Furthermore, the computer hardware required for recording and comparing 
fingerprint data can be centralized and accessed through a telecommunications 
network thereby allowing costs to be amortized across many transactions. 

The disadvantage of biometric identification and verification, and in 
particular fingerprint identification, is in acquiring an accurate image of the 

15 fmgerprint each time an individual desires to use or access the protected item. The 
problems associated with acquiring an accurate fingerprint image include sensor 
device dependent variables, such as hardware defects and deterioration, and 
individual conditions, such as the moisture content and temperature of the feature 
being imaged. 

20 Accordingly, there is needed a sensor device employing methodology that 

accounts for sensor device variability, human biometric variability and adjusts for 
variable conditions that are present when imaging an individual's biometric 
features. 

25 SUMMARY OF THE INVENTION 

The present invention is an q)paratus and a method that increases accuracy 
and reUability of biometric identification and verification techniques. An increase 
in accuracy and reliabihty is achieved by automatically accounting for sensor 
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device variations and adjusting for variable conditions that are present when 
preparing to capture an image of an individual's biometric feature. The present 
invention optimally adjusts for the condition of an individual's biometric features 
and captures multiple images at different optimized sensitivity settings in a 

5 relatively small time frame, such that capture and adjustment processing is 
transparent to the individual. 

hi an exemplary embodiment, the present invention automatically 
determines a set of default settings and diagnostic data for a sensor device first 
based on a blank image. At leastione set of optimized settings is then determined 

10 by automatically adjiisting the set of default settings based on the condition of the 
individual's biometric feature. Images are then captured of the feature, where the 
number of images taken corresponds to the number of optimized sets. The 
methodology corrects the captured image or images with the previously stored 
diagnostic data. If multiple images are captured, the present invention combines 

15 the corrected images to form a resultant image that is of higher quality than any of 
the single images. 

Advantageously, the invention automatically determines default settings 
that provide for a substantially uniform and high contrast image by accounting for 
device variations. The default settings are adjusted for the variable conditions of 

20 the feature being imaged, for example, whether a finger is too wet or too dry, by 
examining a specific set of regions of the image data rather than the entire image. 

In one exemplary embodiment of the present invention, multiple images 
are captured at different sensitivity levels to permit greater accuracy in 
identification. The captured images are corrected with previously determined and 

25 stored diagnostic data, such as non-functional pixel regions. The multiple images 
are then combined by using a weighted and intensity-translated combination of 
regions from the different images to form a resultant image. 
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BRIEF DESCRIPTION OF THE FIGURES 

For a better understanding of the present invention, reference may be had to 
the following description of exemplary embodiments thereof, considered in 
conjunction with the accompanying drawings, in which: 
5 FIG. 1 shows a cross-sectional view of an array of sense elements located 

below two fingerprint ridges of a Gnger surface in accordance with an exemplary 
embodiment of a sensor device used in the present invention; 

FIG. 2 is a block diagram of an exemplary embodiment of a fingerprint 
identification and verification system in accordance with the present invention; 
10 FIG. 3 is a block diagram illustrating the interaction between a sensor device 

and processor in accordance with the present invention; 

FIG. 4A, 4B and 4C show histograms for a dry finger condition, a wet finger 
condition and a normal finger condition; 

FIG. 5 A, 5B and 5C show images of a dry finger condition, a wet finger 
15 condition and a normal fmger condition, respectively; and 

FIG. 6A, 6B and 6C show a first image, a second image and a resultant 
image with the background noise removed, respectively, in accordance with the 
present invention. 

( 

20 DETAILED DESCRIPTION OF THE DRAWINGS 

For clarity of explanation, the illustrative embodiment of the present 
invention is presented as comprising individual fimctional blocks (including 
fimctional blocks labeled as "processors"). The fimctions these blocks represent 
may be provided through the use of either shared or dedicated hardware, 
25 including, but not limited to, hardware capable of executing software. For 
example the fimctions of processors pres^ted in Figures 2-3 may be provided by 
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a single shared processor. (Use of the term "processor" should not, however, be 
construed to refer exclusively to hardware capable of executing software.) 

Illustrative embodiments may comprise microprocessor and/or digital 
signal processor ("DSP") hardware, read-only memory ("ROM") for storing 
5 software performing the operations discussed below, and random access memory 
("RAM") for storing results. Very large scale integration ("VLSI") hardware 
embodiments, as well as custom VLSI circuitry in combination with a general 
purpose DSP circuit, may also be provided. 

The following description is presented to enable a person skilled in the art 
10 to make and use the invention, and is provided in the context of a particular 
appUcation and its requirements. Various modifications to the disclosed 
embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and the scope of the invention. Thus, the present 
15 invention is not intended to be limited to the embodiments disclosed, but is to be 
accorded the widest scope consistent with the principles and features disclosed 
herein. In particular, although the present invention will be described in terms of 
fingerprint identification, one of ordinary skill in the art will recognize that the 
invention is more generally applicable to other individual biometric features. 
20 For purposes of clarity, a top level functional overview of the present 

invention is presented, followed by an exemplary embodiment of a sensor device 
and a system incorporating the methodology of the present invention. A more 
detailed explanation of the methodology is then presented. 

In general, the present invention automatically detennines a set of default 
25 settings (with respect to a blank image) so that a uniform and high contrast image 
results when, for example, a finger is present on the sensor device. As impUed, a 
blank image is an image taken without a fmger being applied to the sensor device. 
A background noise image and other diagnostic data, such as non-functional 
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regions which are commonly referred to as "dead pixels or regions", are also 
automatically determined with respect to the blank image and stored for future 
reference. The above processing is performed each time the sensor device is 
initialized. 

5 Once the initialization process is completed, an individual can place the 

required feature, for example, a finger on tiie sensor device. The invention then 
adjusts the set of default settings to account for variable conditions that are 
present when imaging an individual's biometric feature by increasing or 
decreasing the sensitivity level of the sensor device. The determination of the 
10 optimum sets is achieved by analyzing specific regions of the image data rather 
than the entire image. This increases computational efficiency and permits 
multiple image data to be captured at different sensitivity levels in a short period 
of time. Accuracy is generally increased when using multiple images since one 
region may be optimized with respect to one set of settings and another region 
15 with respect to another set of settings. The diagnostic data is then used to conrect 
the captured images by substituting any dead regions in the sensor device with 
average intensity values from neighboring regions. The multiple images are then 
combined by using a weighted and intensity-transformed combination of regions 
from the different images to achieve maximal overall contrast and quality. 
20 Accordingly, the present invention produces a resultant image that accounts for 
device variations and adjusts for the condition of an individual's biometric 
feature. 

Referring to FIG. 1, th^e is shown an exemplary embodiment of a 
fingerprint sensor device 100 that can be used in conjunction with the present 

25 invention, and is explained in related U.S. Patent Application Serial No. , 

entitled "Capacitive Fingerprint Sensor Device With Adjustable Gain," by 
inventors Alexander G. Dickinson, Ross McPherson, Sunetra Mendis and Paul C. 
Ross and having a filing date of May 13, 1997, and having cominon assignees. 
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This patent application hereby incorporates by reference the above-referenced 
patent application. 

Fingerprint sensor device 100 contains an array of sense elements 120 
(also referred to as electrodes or cs^acitor plates). FIG. 1 also illustrates a finger 
5 surface 160 which is placed in close proximity to sensing surface 140. Because 
finger surface 160 is uneven, certain portions of the finger surface 160 (ridges 
180) will be in close proximity to the sensing surface 140, while other portions 
(valleys 190) will be farther firom sensing surface 140. Each sense element 120 
forms a capacitor with the portion of finger surface 160 located directly 
10 thereabove. Sense elements 120 form one set of capacitor plates with the other 
plate comprising finger surface 160. 

When a finger at a known potential, such as ground, is brought in close 
proximity to sensing surface 140, the capacitance on sense elements 120 changes. 
The surface of the finger is uneven, with "ridges** and "valleys", typically a few 
15 hxmdred microns s^art, forming the **print" of the finger. The ridges of the print 
will be closer to sensing surface 140, and the valleys will be further away, 
typically by about 100 microns. Since the capacitance (C^) between a metal plate 
and finger surface 160 depends on the distance and the material between the two, 
it will vary with the finger topography. 
20 It is possible then to obtain an image of the fingerprint by measuring 

capacitance across the array because capacitors formed by a plate-ridge pair will 
have a much greater capacitance than those formed by a plate-valley pair. 
Capacitance between these limits will be created in areas of the finger that Ue 
between a ridge and valley. The images from the sensor devices can contain, for 
25 example, grey level information, where each sense element 120 or pixel has a 
digital value ranging firom one value that represents white to another value that 
represents black, with values representing shades of grey in between. In an 
exemplary embodiment, an 8 bit grey scale can be used to represent 256 shades. 
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Referring now to FIG. 2, there is shown an exemplary embodiment of a 
fingerprint identification and verification system 200 which uses the methodology 
of the present invention to identify individuals. System 200 includes an array unit 
210 coupled to a computing system that further includes a digital signal processor 

5 220 and a computer 230. Digital signal processor 220 coimects to a set of row 
address lines 235 and a row of column address lines 240 which feed into array 
unit 210. Digital signal processor 220 also outputs control signal 245, which 
comprises a plurality of control signals also feeding into array imit 210. The 
output from array unit 210, which is in analog form, feeds into A/D converter 250. 

10 The A/D converter 250 converts the analog signal into a digital signal which feeds 
into digital signal processor 220. Digital signal processor 220 processes the output 
from A/D converter 250 and feeds the processed output through processed data 
line 255 to bus interfrice 260. Finally, bus interface 260 feeds this output into 
computer 230. 

15 Operationally, the circuitry in FIG. 2 functions as follows. Digital signal 

processor 220 feeds a number of signals into array unit 210, including row address 
235, column address 240 and control signals 245. These signals cause sense 
elements in array unit 210 to cycle through charge and discharge cycles to 
nieasure capacitance on sense elements within array 210. The output of array imit 

20 210 is then fed into A/D converter 250, which converts the output into digital 
form which feeds into digital signal processor 220. Digital signal processor 220 
takes this output and processes it to create processed data 255, which is 
transferred through bus interface 260 into computer 260. Digital signal processor 
uses RAM 270 to store the instructions and code involved in this process. 

25 The present invention evaluates the image to determine whether the image 

of a fingerprint acquired by array unit 210 is of sufficient quality for identification 
purposes. If not, digital signal processor 220 feeds control signals 245 into array 
unit 210 to automatically adjust the gain on sense elements within array unit 210. 
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This gain adjustment may be accomplished by automatically adjusting the timing 
between samples of the voltage on the sense elements, or alternatively, by 
automatically adjusting the current flowing through the current source within each 
sense element by adjusting an external potentiometer. After a number of iterations 
5 of gain adjustment have been accomplished, and a satisfactory image has been 
gathered from array unit 210, processed data 255 is fed through bus interface 260 
to computer 230 where the data can be used for a variety for identification 
purposes. 

Referring now to FIG. 3, there is shown a more detailed block diagram of 
10 the interaction between a sensor device 320 and a processor 325. For purposes of 
clarity, the present invention is functionally separated into four sections, hi an 
exemplary embodiment of the present invention, each of the four sections is 
implemented in processor 325. In the first section, a set of default settings for the 
:Sensor device are automatically determined based solely on a blank image 
15 (without a fingerprint). Backgroimd noise and other diagnostic data for the sensor 
device, such as dead rows or columns, is determined based solely on the blank 
image. In the third section, the set of default settings are automatically adjusted to 
optimize for variable conditions that may be present when imaging an individual's 
biometric feature. The captured image or images from the optimally set sensor 
20 device is then corrected using the diagnostic data and if applicable, combined to 
form the resultant image. Each of the four functional sections is now described in 
more detail with reference to FIG. 300. 

Accurate and reUable identification and verification is increased by setting 
the sensitivity of the sensor device such that it accounts for device variations. 
25 Calibration of the sensor device is automatically achieved by using two different 
techniques. During initialization of sensor device 320 (when no finger 310 is 
present on sensor device 320), processor 325 adjusts the settings of sensor device 
320, as explained above, until a sensitivity level is determined that will yield a 
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uniform, high-contrast image when a finger is placed on sensor device 320 
(330-340). The objective is to automatically determine the settings that yield the 
best quality image, where the best quality image is defined by a mathematical 
function. In sum, the mathematical function determines the most uniform image 
5 (spatially across the image area) whose minimum intmsity values are close to 
white. This will yield the desired uniform, high-contrast image when a fingerprint 
is present on the device. 

In accordance with the present invention, a quality image is defined by 
two parameters, imiformity and contrast FIGs. 6A-6B and 6C illustrate bad 
10 quality images and a good quality image (with the background noise removed), 
respectively. Specifically, the dark bands in FIGs. 6 A and 6B represent areas of 
non-unifomMty. Uniformity across the image is achieved by determining the 
average intensity of a set of defined regions, such as columns or rows, and by 
computing the range or variance of intensities of each defined region. Maximum 
IS contrast capability is achieved by adjusting the settings until the minimum 
intensity of the original range is translated to zero and the original range is 
expanded to occupy the full range. These two parameters are balanced across the 
image to produce the uniform default settings. 

The second calibration technique is also performed during initialization 
20 and automatically determines diagnostic data that is specific to how sensor device 
320 is fabricated. As described below, the exemplary embodiment of sensor 
device 320 is a solid state device. As such, there is the possibility of '"dead areas" 
or non-functional areas such as dead pixels, or rows, columns and regions of dead 
pixels. Dead areas result fi:om manufacturing defects or firom damage due to 
25 electrostatic discharge. This is similar to a memory device where rows and 
columns may be non-functional. Furthemiore, due to variable electronic device 
characteristics, nodes may have some degree of non-uniformity, which will yield 
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a non-unifonn, noisy-image. The present invention automatically deteraiines this 
diagnostic data from a blank image. 

Non-functional areas are determined by calculating the variance along, for 
example, a region, a row or a column of the image and evaluating whether the 
5 variance is zero, that is there is no sensor variation in any of the pixels in the 
region. If the variance is zero, then the region, row or column is presumed non- 
functional. Alternatively, dead pixels can be determined by looking for a 
maximum or minimum intensity value in the pixels. The diagnostic data is stored 
and used later to correct these defects in the captured images of the fingerprint. In 
10 one embodiment of the present invention, a history file of the diagnostic data is 
kept to track sensor device degradation. The non-uniform background noise image 
is stored by processor 325 for future refo'ence. Since the image is constantly 
changing, the background noise image being stored is really a time, averaged 
image of multiple images. Alternatively, a background image can be stored at 
15 each of the different sensor sensitivity settings or at specified sensitivity settings. 
As explained below, the background image or images can be subtracted from the 
captvu-ed image or images. 

By performing an adjustment during initialization, the present invention 
eliminates the disadvantages of conventional devices that are calibrated on a one 
20 time basis in a specific region of the world, where certain environmental 
conditions, such as temperature and humidity, later change from the time of 
calibration. The present invention automatically determines a set of default 
settings that account for device variations and different environmental conditions, 
such as being operated in different regions under drastically different temperature 
25 and humidity ranges. As stated above, the first two steps in the methodology are 
performed during initialization of the sensor device. If desired, a user may re- 
initialize the sensor device to reset the default settings, to obtain new diagnostic 
data or to do both. 
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Once sensor device 320 is initialized and calibrated, a finger 311 can be 
placed on sensor device 320. The variable conditions of finger 31 1, for example, 
moisture level and cleanliness, can generally detrimentally affect the ability of 
sensor device 320 to produce a quality image with the default settings. 
5 Accordingly, sensor device 320 may yield results that vary, for example, with 
finger moisture, finger cleanliness and other such variable conditions. FIG. SA, 
for example, shows a histogram of when the finger is too dry and FIG. 5B shows 
a histogram of when the finger is or too wet. The third functional section of the 
present invention substantially improves the image quality by optimally adjusting 
10 the settings while capturing the fingerprint image. This present invention 
automatically determines the condition of finger 311 and correctly adjusts the 
sensitivity settings 341 prior to image capture 330. The present invention 
increases the sensitivity, for example, when the finger is too dry and decreases the 
sensitivity, for example, when the finger is too wet. Typical fingerprint sensor 
15 devices require the user to wet the finger or dry the finger, as needed. The present 
invention methodology eliminates the need for user interaction by automatically 
adjusting for the condition of the biometric feature being imaged. 

The present invention determines the condition of the finger by examining 
specific regions of the captured data rather than the total image. The specific 
20 regions can be, for example, rows or columns of data fi'om the sensor device that 
are centrally located on the image, but are separated enough to provide 
representative samples of the image. In one embodiment of the present invention, 
the diagnostic data is used to select specific regions that do not contain dead 
pixels. This ability to analyze the condition of the finger using partial image data 
25 is an advantage of using the exemplary embodiment of sensor device 320 
discussed herein. Moreover, the present invention system is computationally 
efficient and is not available with conventional sensor device systems. 
Specifically, since optical sensor based systems are inherently analog, they must 
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capture the total image. This is a computationally intensive procedure and would 
generally require a time period that would not be user friendly. In contrast, the 
present invention accomplishes the analysis of the partial image data in 
milliseconds and completes the whole process in approximately one second. As 
5 such, not only does the present invention generally increase the accuracy of the 
system, it does so by being transparent to the individual and without any user 
interaction. 

The present invention analyzes the image contrast or the ratio of black to 
white, for example, by examining histograms of the captured data. Specifically, 

10 the histograms of gray level data are created for each of the specific regions and 
combined into a single histogram that represents the image for a given set of 
settings. This histogram is referred to as, for purposes of clarity, a representative 
histogram. The settings are varied systematically and a representative histogram is 
saved for each combination of the settings. In the exemplary embodiment, there 

15 are a predefined number of combinations that are selectable by using a look-up 
table (341). After stepping through all or a subset of the entries in the look-up 
table (341), the representative histograms for each combination of settings is 
analyzed by calculating a score for each histogram. Referring to FIGs. 4 A, 4B and 
4C, an exemplary method for calculating a score first requires determining an area 

20 under each peak that is present in the histogram and by determuaing a separation 
value between the peaks, if applicable. The score is then set equal to: 

SCORE = Separation - ABSOLUTE VALUE (AREA LEFT - AREA RIGHT) 

Alternative methods and criteria for evaluating which histogram is the best are 
also implementable. Using the exemplary method, the histogram that corresponds 
25 to the settings that resulted in the image with the most contrast is . the histogram 
that has the highest SCORE. For example, if the analysis of the histogram reveals 
two distinct peaks of nearly the same height (as shown in FIG. 4C for a normal 
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finger condition), the score would be higher than either histogram shown in FIG. 
4 A (for a dry finger) or FIG. 4B (for a wet finger). FIGs. 5 A, 5B and 5C show 
fingerprint images corresponding to the histograms of FIG. 4A, 4B and 4C. The 
proper or optimal settings for sensor device 320 are then those corresponding to 

5 the highest score. In one embodiment, a predefined number of the highest scores 
are used to capture multiple images of the fingerprint. In another embodiment, the 
setting conresponding to the highest score is selected and multiple images are then 
taken by selecting additional settings on either side of the optimized setting. This 
bracketing of the optimized setting permits the invention to take multiple images 

10 and make a composite image firom the best regions in each image. 

In an exemplary embodiment of the present invention, sensor device 320 
controls the sensitivity level by varying the discharge time or the discharge 
voltage. Specifically, sensor device 320 at least has seven difTorent settings for 
varying the discharge time and at least 100 different settings for varying the 

15 discharge voltage. Conventional optical sensor devices cannot adjust for 
individual finger conditions. As such, the images obtained by such systems are 
non-optimal. In contrast, the sensitivity selection process of the present invention 
is continued until a substantially uniform, high-contrast image is obtained as 
illustrated in FIG. 4C. Since this requires balancing uniformity across the image 

20 with the need for high contrast, multiple optimum sensitivity levels may exist As 
a result, the present invention method may capture multiple images, one image at 
each of the optimized sensitivity levels. 

The last fimctibnal section of the present invention uses the information 
and images obtained in the first three parts to produce a high quality, resultant 

25 image. The image or images captured are first corrected with the diagnostic data 
obtained in part 2 (350). Specifically, the diagnostic data is used to correct for 
dead pixels, regions, rows or colunms by replacing them with average intensity 
values fi'om their neighboring pixels or regions. In one embodiment of the present 
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invention, non-iinifonn background noise is also subtracted from each of these 
images. In another embodiment, background noise corresponding to each of the 
settings used is subtracted from the particular image. 

If multiple images were captured in section three above, then the present 
5 invention uses a weighted and intensity-transformed combination of regions from 
different images (360) to form a resultant image (370). The weightings are 
selected such that higher contrast regions of a particular image are chosen over 
lower contrast regions of the other images to obtain the best overall composite 
image. Although each of the captured images is a good quality image, there are 
10 regions within each image that provide greater contrast than the counterpart 
regions in the other images. The image combination or composition step takes 
advantage of this by weighting regions based on contrast levels. This intensity 
translated weighting is performed region by region per captured image, where a 
region can be, for example, a row or column. 
15 As stated above, when multiple images are taken they are combined by 

using an intensity-shifted and weighted combination of regions from different 
images captured at different settings. The calculation is made using two parameter 
values: intensity shift and intensity range. 

In general, the intensity shift value detennines which section of the 
20 intensity range the image data is occupying. This is then used to shift the actual 
intensity values such that the fiiU intensity range is maximally occupied to provide 
the best potential for image contrast. In an exemplary embodiment, intensity shift 
is calculated as the diff^ence between a fixed intensity and the average intensity 
value in the region. In the exemplary embodiment, the value of the fixed intensity 
25 is chosen as the middle intensity in the potential, full intensity range. For 
example, when using an eight bit grey scale, the full intensity range is 0-256 and 
the middle intensity value is 128. In another embodiment, instead of using the 
average intensity value in the region, the present invention uses the maximum 



15 



wo 99/26187 



PCTAJS98/23698 



intensity value, minimum intensity value, or the intensity value corresponding to 
the maximum or minimum peak in the intensity histogram. 

In the exemplary embodiment, the intensity range is determined by 
calculating the difference between the maximum and minimimi intensity value in 
5 the region. In another embodiment, the intensity range is a fixed number, n, times 
the standard deviation of the intensity values in the region, where n is usually 
small, for example n = 1 or 2. In still another embodiment, the intensity range is 
the intensity difference between the maximum peak on the background intensity 
histogram and the minimum peak on the image intensity histogram (which 
10 represents ridge intensity values). In general, the present invention determines the 
spread in the grey levels, which is a measure of contrast. 

Using the above methods, the present invention calculates the intensity 
shift and intensity range for each corresponding region in each image. In equation 
form: 

15 

Intensity__Shift (imagej, regionj) = Average Jntensity (imagCi, region^) - 1 28 
Intensity_Range (imagej, regionj) = Max Jntensity (imagCi, regionj) - Min_Intensity (imagCj, 
regioiij) 

20 The intensity values in each region are then translated by its intensity shift value 
to best utilize the full intensity range. For example, if the average intensity of the 
region is below 128, then the present invention will move each of the pixel 
intensity values in the region toward the maximum intensity value by the intensity 
shift value. This is performed pixel by pixel in each region of each image. In 

25 equation form: 

' Intensity^Shifted p^ei (imagcj, regionj) = Intensitypj^ei (imagei, region^ - Intensity^Shift 
(imagei, regiouj) 
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After performing the intensity shift on each pixel in each region of each image, all 
corresponding pixels in each image are added. In equation form: 

Intensity_Sumpi^i (region^) = Sum (Intensity_ShiftedpUei (imagej, regionj)). i = 0, n-1, for n 
S images 

The intensity sums for each region are then multipUed by a weight to obtain a 
resultant image, where the available intensity range is maximally occupied by the 
pixel intensity values in the resultant image. In equation form: 

10 

Sum_of_Ranges (regionj) = Sum (Intensity_Range (imagej, regionj)), i = 0, n-l, for n images 
Weight (regioDj) = 255 / (Sum_of__Ranges (regioiij)) 

Iiiteiisity_Resultantpixei= Intensity^Sumpijt^ (rcgionj) x Weight (regioiij), for j = all regions 

15 In one exemplary embodiment of the present invention, the resultant image is 
obtained by taking the average of the sum of the captured images. In another 
exemplary embodiment of the present invention, the non-uniform background 
noise is subtracted from the resultant image. This is illustrated in FIC3rs. 6A and 
6B, where 2 images are combined by averaging and by having their backgrounds 
20 subtracted out to form the resultant image shown in FIG. 6C. 

As shown herein, the present invention automatically determines a set of 
default settings given device variability and adjusts these default settings for 
variable conditions that may be preset when imaging the individual's biometric 
feature. The optimally adjusted settings are then used to capture one or more 
25 images for the purpose of yielding the best quality, resultant, single image. 

The exemplary embodiment of the fingerprint sensor device for use in 
conjunction with the present invention methodology and system may be 
fabricated from any appropriate materials known in the art. In some applications it 
is advantageous to employ solid state sensor devices that can contain in a single 



17 



wo 99/26187 PCT/US98/23698 

unit the sense elements and associated circuitry to read out the value of each sense 
element such as, for example, amplifiers, noise reduction circuitry, and analog-to- 
digital converters. Some examples of suitable integrated circuit devices include 
devices fabricated by conventional CMOS processing techniques. Such solid 
5 state devices are typically covered by a layer of silicon dioxide several microns 
thick. 

The present invention system may be incorporated into a variety of 
different devices to provide an indication that a person having possession of the 
device is authorized to use the device. For example, authentication cards such as 
10 credit cards, debt cards, smart cards, etc., often require the user to provide a 
personal identification number (PIN) prior to use. If the card itself is 
misappropriated, the PIN would not be known to unauthorized users. However, 
the PIN would be given to, and known by, a merchant when the card holder 
initiates a transaction. It is also possible for the PIN to be misappropriated by a 
15 person who overhears a transaction or observes the cardholder as the PIN is 
written or entered via a keyboard or by a vendor to whom the customer gives the 
PIN to authorize themselves. 

These problems can be overcome by incorporating the present invention 
into an authorization card. The card includes circuitry for comparing the acquired 
20 fmgerprint against those of an authorized user or users, which are stored in a 
memory incorporated into the card. When the card is presented for use, the user 
verifies that he or she is an authorized user by placing a finger on the sensor 
device located on the card. 

The present invention fingerprint system also may be incorporated into 
25 other validation devices that store fingerprints of authorize users. For example, 
the 'fingeq)rint system may be incorporated into an automated teller machine 
(ATM). The user would be required to demonstrate that he or she is an authorized 
tiser prior to performing a transaction. The fingerprint system also may be 
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incorporated into a validation or authorization device in possession of a merchant 
at a point of sale, for example. 

Numerous modifications and altemative embodiments of the invention 
will be apparent to those skilled in the art in view of the foregoing description. 
5 Accordingly, this description is to be construed as illustrative only and is for the 
purpose of teaching those skilled in the art the best mode of carrying out the 
invention. Details of the structure may be varied substantially without departing 
from the spirit of the invention and the exclusive use of all modifications which 
come within the scope of the appended claim is reserved. 
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WHAT IS CLAIMED IS : 

1 . A method for sensing and analyzing an individual feature, said method 
comprising the steps of: 
5 automatically determining a set of default settings for a sensor device 

based on a blank image; and 

automatically adjusting said set of default settings based on variable 
conditions that may be present when capturing an image of the individual feature. 

10 2. The method according to claim 1, wherein the step of automatically 
adjusting includes the step of forming at least one set of settings that are 
optimized for the individual feature. 

3. The method according to claim 2, further including the step of capturing a 
15 corresponding image for each of said at least one set of settings. 

4. The method according to claim 3, further including the steps of: 
forming at least one additional set of settings that are optimized for the 

individual feature; 

20 capturing an additional conresponding image for each of said at least one 

additional set of settings; and 

combining said corresponding image with said additional corresponding 
image to form a resultant image. 

25 5. The method according to claim 4, wherein said step of combining includes 
the steps of: 

detemuning an intensity shift value for each region comprising said 
corresponding image and said additional corresponding image; and 
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determining an intensity range for said each region, 

wherein said intensity shift value and said intensity range are used such 

that each pixel in said each region maximally occupies an available intensity 

range in said resultant image. 

5 

6. The method according to claim 1, further including the steps of: 
collecting diagnostic data for said sensor device based on the blank image; 

and; 

correcting at least one captured image with said diagnostic data, said at 
10 least one captured image taken with a corresponding set of adjusted settings. 

7. The method according to claim 6, wherein said step of correcting includes 
the step of substituting non-functional areas of pixels with average intensity 
values from neighboring pixels. 

15 

8. The method according to claim 6, wherein said step of collecting further 
includes the step of maintaining a history file for said diagnostic data to track the 
sensor device degradation. 

20 9. The method according to claim 1 , fiirther including the steps of: 
capturing multiple images at a corresponding set of optimized settings; 
correcting each of said multiple images with stored diagnostic data; and 
combining said multiple images to form a resultant image. 

25 10. The method according to claim 9, wherein said step of combining utilizes 
intensity translated weighting to obtain said resultant image. 
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1 1 . The method according to claim 9, wherein said step of combining includes 
faking an average of said multiple images to obtain said resultant image. 

12. The method according to claim 9, further including the step of subtracting 
5 out a background noise image from said resultant image. 

13. The method according to claim 9, further including the steps of: 
capturing a corresponding background image for at least one set of 

predefined settings based on the blank image; and 
10 subtracting out said corresponding backgroimd image when said 

corresponding set of optimized settings is equal to said at least one set of 
predefined settings. 

1 4. The method according to claim 1 , further including the steps of: 

15 correcting at least one captured image with diagnostic data, said at least 

one captured image taken with a corresponding set of adjusted settings; and 
subtracting out a background noise image from a corrected image. 

1 5 . The method according to claim 1 , wherein the step of automatically 
20 determining 

includes the steps of: 

calculating average intensity values for regions comprising an image area 

of said sensor device; 

computing a variance for each of said regions to establish uniformity 

25 across said image area; and 

providing maximum contrast capability by adjusting sensor device settings 
until the minimum intensity in an original intensity range of said blank image is 
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translated to zero and said original range is expanded to occupy a full intensity 
range. 

1 6. The method according to claim 1 , wherein the step of automatically 
5 determining includes the step of analyzing partial image data to determine a 

condition of said individual feature. 

17. The method according to claim 1 6, wherein said step of analyzing 
examines image contrast by looking at grey levels of said partial image data. 

10 

18. The method according to claim 1 , wherein the step of automatically 
determining includes the steps of: 

capturing at least one region of data from multiple regions of data; and 
creating a grey level histogram of said at least one region to examine 
15 contrast levels. 

19. The method according to claim 1 , wherein the step of automatically 
determining includes the steps of: 

analyzing at least one histogram of partially captured data corresponding 
20 to at least one set of adjusted settings; and 

selecting at least one set of settings based on said at least one histogram. 

20. The method according to claim 1, wherein said step of automatically 
adjusting includes the step of selecting a setting for a discharge timer, 

25 

2 1 . The method according to claim 1 , wherein said step of automatically 
adjusting includes the step of selecting a setting for a discharge voltage. 
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22. An apparatus for sensing and analyzing an individual feature, said 
apparatus comprising: 

a processor for analyzing at least one set of image data; and 
a sensor for providing said at least one set of image data to said processor; 
5 said processor determining automatically a set of default settings for said 

sensor based on a blank image; 

said processor adjusting automatically said set of default settings based on 

variable conditions that may be present when capturing an image of the individual 

feature. 

10 

23. The apparatus according to claim 22, wherein said processor analyzes 
contrast levels of the individual feature by capturing partial image data sets from 
said sensor. 

15 24. The apparatus according to claim 22, wherein said processor analyzes 
image contrast by looking at grey levels of partially captured image data sets. 

25 . The apparatus according to claim 22, wherein: 

said processor captures at least one region of data from multiple regions of 

20 data; 

said processor creates a histogram of said at least one region to examine 
contrast levels of the individual feature; and 

said processor selects at least one adjusted iset of settings based on said 
histogram. 

25 

- 26. The apparatus according to claim 22, wherein: 

said processor adjusts said default settings to create at least one set of 
settings ttiat are optimized for the individual feature; and 
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said sensor provides a corresponding set of image data for each of said at 
least one set of settings. 

27. The apparatus according to claim 22, wherein said processor includes: 
5 storing means for saving diagnostic data collected from said sensor device 

based on the blank image; and 

means for correcting at least one set of optimized image data received 
from said sensor with said diagnostic data. 

10 28. The apparatus according to claim 22, wherein said processor corrects said 
at least one set of image data received from an optimally set sensor by substituting 
non-ftinctional areas of pixels with average intensity values from neighboring 
pixels. 

15 29. The apparatus according to claim 22, wherein said processor maintains a 
history file for diagnostic data to track sensor degradation. 

30. The apparatus according to claim 22, wherein said processor includes: 
capture means for receiving multiple sets of image data corresponding to 

20 multiple settings of the sensor; 

diagnostic correction means for correcting each of said multiple sets of 
image data with stored diagnostic data; and 

means for combining said multiple sets of image data to form a resultant 

image. 

25 

3 1 . The apparatus according to claim 30, wherein said multiple sets of image 
data are comprised of multiple regions, wherein said means for combining 
combines said multiple sets of image data region by region using intensity 
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translated weighting for each of said multiple regions to obtain said resultant 
image. 

32. The apparatus according to claim 30, wherein said means for combining 
5 combines said multiple sets of image data by taking an average of said multiple 

sets of image data to obtain said resultant image. 

33. The apparatus according to claim 30, wherein said means for combining 
includes: 

10 means for determining an intensity shift value for each comprising said 

multiple sets of image data; and 

means for determining an intensity range for said each region, 
wherein said processor uses said intensity shift value and intensity range 
such that each pixel in said each region maximally occupies an available intensity 
1 5 range in said resultant image. 

34. The apparatus according to claim 22, wherein said processor subtracts out 
a background noise image from at least one set of image data received when said 
sensor is optimally set. 

20 

35. The apparatus according to claim 22, wherein said processor corrects at 
least one set of image data received when said sensor is set with at least one set of 
adjusted settings. 

25 36. The apparatus according to claim 22, wherein said processor includes 

means for calculating average intensity values for regions comprising an 
image area of said sensor; 
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means for computing a variance for each of said regions to establish 
uniformity across said image area; and 

means for adjusting sensor device settings until the minimum intensity in 
an original intensity range of said blank image is translated to zero and said 
5 original range is expanded to occupy a full intensity range such that maximum 
contrast capabihty is provided. 

37. A fingerprint device for sensing and analyzing a fingerprint, said device 
comprising: 

10 a processor for analyzing fingerprint image data; and 

a sensor for providing said fingerprint image data to said processor; 
said processor determining automatically a set of default settings for said 
sensor based on a blank image; 

said processor including a diagnostic correction means for storing 
15 diagnostic data collected from said sensor based on the blank image; 

said processor including adjustment means for adjusting automatically 
said set of default settings based on variable conditions that may be present when 
capturing a fingerprint image of the fingerprint; 

said diagnostic correction means correcting at least one set of fingerprint 
20 image data received from said sensor when said sensor is set with at least one set 
of adjusted settings. 

38. The device according to claim 37, wherein said processor includes means 
for combining said at least one set of fingerprint image data with at least one 
25 additional set of fingerprint image data to form a resultant image, said at least one 
additional set of fingerprint image data corresponding to at least one additional set 
of adjusted settings. 
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39. The device according to claim 38, wherein said fingerprint image data 
comprises multiple regions, said means for combining uses intensity translated 
weighting for each of said multiple regions to combine said at least one set of 
fingerprint image data with said at least one additional set of fingerprint image ' 

5 data. 

40. The device according to claim 38, wherein said means for combining 
combines said multiple sets of fingerprint image data by taking an average of said 
multiple sets of fingerprint image data to obtain said resultant image. 

10 

41 . The device according to claim 37, wherein said processor includes an 
analyzer for examining contrast levels of partially captured fingerprint image data 
firom said sensor. 

15 42. The device according to claim 37, wherein said processor includes an 

analyzer for examining fingerprint image contrast levels by looking at grey levels 
of partially captured fingerprint image data. 

43, The device according to claim 37, wherein said adjustment means captures 
20 at least one region of data firom multiple regions of fingerprint image data and 

creates a grey level histogram of said at least one region of data to examine 
contrast levels of the fingerprint captured. 

44. The device according to claim 37, wherein said diagnostic correction 
25 means corrects said at least one set of fingerprint image data received firom an 

optimally set sensor by substituting non-fimctional areas of pixels with average 
intensity values firom neighboring pixels. 
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45. The device according to claim 37, wherein said diagnostic correction 
means maintains a history file for said diagnostic data to track sensor degradation. 

46. The device according to claim 37, wherein said processor subtracts out a 
5 background noise image from said at least one set of fingerprint image data. 
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